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Abstract 

This paper presents an algorithm which solves exponentially fast the 
average consensus problem on strongly connected network of digital links. 
The algorithm is based on an efficient zooming-in/ 'zooming- out quantiza- 
tion scheme. 



1 Introduction 

Problems of coordination, and in particular of distributed averaging, have be- 
come an important subject of research for control theorists [16]. In the average 
consensus problem, N agents are given one number each, and have to com- 
pute their average. The interest of the problem comes from the communication 
limitations the agents are subject to, which require the design of an iterative 
algorithm. Usually, the agents are allowed to communicate with a restricted 
number of neighbors, and this is described by a suitable directed graph. In this 
work, we present an average consensus algorithm in which the agents can com- 
municate with their neighbors only via rate constrained digital channels. We 
propose an efficient encoding/decoding strategy, based on the so called zooming- 
in/zooming-out quantization method [3, 17, 14], and we give theoretical and 
simulation results on its performance. The algorithm solves the average con- 
sensus problem with arbitrary precision in exponential time, using a quantizer 
with number of states which is finite, but can depend on N. 

1.1 Related works 

The constraint of quantization of messages, or of states, has been considered 
in several recent papers [18, 9, 5, 11, 13, 12, 15, 1]. However, existing algo- 
rithms in the literature are not able to achieve average consensus with arbitrary 
precision, with the notable exception of [4], which uses logarithmic quantizers, 
together with a coding scheme similar to the one in the present paper. The 
zooming- in/zooming-out algorithm and the main convergence result of this pa- 
per appeared, in slightly different version, in [6] and in the thesis [10]. Note that 
recently [2] a modification of the present algorithm has been proved to converge 
under a different condition. 
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1.2 Outline 



The problem of average consensus is formally presented in Section 2. The al- 
gorithm, and the main result, are in Section 4. In Section 5 we present several 
simulations, which show an encouraging performance, beyond the scope of the 
proven result. Finally, Section 6 points out some potential developments. 

2 Average consensus 

Let there be a directed graph Q = (V,E), with V = {1, . . . ,7V} a set of dy- 
namical systems, that we call agents. We assume that only if (j, i) € E, j can 
transmit information about its state to i. Let us consider, for t £ Z>o, the 
following discrete-time state equations 

Xi(t + 1) =Xi{t)+Ui(t) i = l,...,N 

where Xi(t) £ 1 is the state of the i-th system/agent, and € R is the 

control input. More compactly we can write 

x(t + 1) = x(t) + u(t) (1) 

where x{t),u(t) G R N . 

Definition 1 (Average consensus problem) Given the system (1), the av- 
erage consensus problem consists in designing a sequence of control inputs u(t) 
yielding the consensus of the states, namely 

lim x{t) = x ave (0)1, (2) 

t — >+oo 

where 1 is a TV -vector whose entries are 1. 

The important case we restrict to, and which has been mostly studied in liter- 
ature, is a static linear feedback 

u(t)=Kx(t) K g R NxN (3) 

In such case the system (1) is given by the following closed loop system 

x(t + l) = (I + K)x(t). (4) 

The matrix I + K is commonly called a Perron matrix, and denoted by P. The 
problem of designing the controller thus reduces to find a matrix K adapted to 
in the sense that if (j, i) ^ E, then = 0. Methods for design are known in 
the literature [8]. We shall only recall here that the average consensus problem 
is solved if and only if the matrix P is a doubly stochastic matrix. 
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2.1 Quantization 



We can make the framework (3) more general if we assume that the agents can 
not directly access their neighbors' states, but can obtain estimates or approxi- 
mations of them. Let x^ft) be the estimate agent i has of the state of agent j, 
at time t. The control input Ui(t) assumes the following form 

N 

u l {t)=Y J K l] x l J {t). (5) 

j=i 

Due to the possibility that Xj (t) ^ Xj (t) , such a control is not in general guar- 
anteed to yield convergence to consensus, nor to preserve the average of states. 

Most of the literature on the consensus problem assumes that the commu- 
nication channels between the nodes allows to communicate real numbers with 
no errors. In practical applications this can be an unrealistic assumption: the 
communication is in most cases digital and the channel is noisy. There can 
be strict bandwidth constraints, as well as communication delays, and packet 
losses due to interferences and erasures. These limitations are mostly likely to 
be significant for a network communicating in a wireless fashion, which is nowa- 
days a typical choice. In this paper, we concentrate on modeling the links as 
instantaneous and lossless digital channels. This choice forces a quantization 
on the real numbers that agents have to transmit, but keeps aside the issues of 
delays and packet losses. 



3 Encoding-decoding schemes 

From now on, let us assume to have a strongly connected directed graph Q and 
an average consensus controller K adapted to Q . In the extended communication 
framework (5), the control input Ui(t) of agent i has the following form 

N 

Ui(t)=J2Kijxi(t), (6) 
j=l 

where is the estimate of the state Xj which has been built by the agent i. 
The point now is to describe how the estimates are built. In other works, [11], 
[7], we have assumed that the estimate be just the transmitted message. Now, 
instead, we look for a non trivial way of constructing estimates. 

Suppose that the j-th agent sends to the i-th agent, through a digital chan- 
nel, at each time instant t, a symbol Sjj (t) belonging to a finite or countable 
alphabet <Sjj , called the transmission alphabet. It is assumed that the channel is 
reliable, that is each symbol transmitted is received without error. In general, 
the structure of the coder by which the j-th agent produces the symbol to be 
sent to the i-th agent can be described by the following equations 

f &(* + !) - Fy(fo(t),«y(f)) 
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where Sij(t) £ S lj} £ i-7 -(t) £ Sy, Qij : Ey x R -> 5y, and : S x Sy — ► Ey. 
The decoder, run by agent i, is the system 

&(t+l) = *«(&(*),*«(*)) , R x 
£*•(*) = #«(&(<),*«(*)), 1 j 

where ify : Sy x«Sjj — > R. The set Hy serves as siaie space for the coder/decoder, 
whereas the maps i^-, Qij , Hij represent, respectively, the coder/decoder dynam- 
ics, the quantizer function, and the decoder function. Coder and decoder are 
jointly initialized at £ij(0) = £o- 

In general, one may have different encoders at agent j, according to the various 
agents the agent j wants to send its data. For the sake of simplicity, we assume 
in the sequel that each system uses the same encoder for all data transmissions. 
Thus, each agent j broadcasts the same symbol Sj(t) to all its neighbors. In this 
case every agent receiving data from j obtains the same estimate of Xj(t), which 
we shall denote by Xj (t) . In this way, by letting Fj = Fij , Hj = H^ , Qj = Qij 
and Sj = Sy, the previous coder/decoder couple can be represented by the 
following state estimator with memory 

tj(t+l) = ^&(t),*j(*)) 

*i® = (9) 

Moreover (6) assumes the following form 

N 

Ui (t) = ^K ij x j {t), (10) 

and the system evolution is 

x(t + l) =x{t) +Kx(t). (11) 

Remark 1 (Need for synchrony) Remark that, from the point of view of 
the implementation, both agent j and its neighbors have to run identical copies 
of the system £,j(t). This clearly implies an intrinsical weakness of the scheme 
with respect to failures: if messages are lost, the synchrony of these copies is 
lost as well, and the algorithm does not work. 

In change of this potential drawback, the scheme has very interesting conver- 
gence properties. 



4 Zooming-in zooming-out strategy 

Our strategy is inspired by the quantized stabilization technique proposed in [3] , 
which is called zooming- in/zooming-out strategy. In this case the information 
exchanged between the agents is quantized by scalar uniform quantizers which 
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assume values in a finite set, and can be described as follows. For m £ N define 
the set of quantization levels 

S m = {-1 + ^— ^ \ £ e {l,...,m}} U{-1, 1}. 
m 

The corresponding uniform quantizer q( m ' : K — > <S m is as follows. Let ir g K 
then 

g(-)( aj ) = -l + ^Zl 

m 

if £ e {1, . . . ,m} satisfies -1 + <x <-l + ^ : otherwise q { ~ m \x) = 1 if 

x > 1 and g (m) (x) = -1 if x < -1. 

It is easy to see that the quantizer g( m ) enjoys the following property. 

Lemma 1 (Quantization error) Given z GM. and I £ K>o such that \z\ < I, 
it holds 

1 



lq^ (f ) | < -i. (12) 



Let m £ N, fc; n €]0, 1[, and fc out g]1,+oo[. The zooming-in/zooming-out 
encoder/decoder, with parameters m, k- m , fc out , is defined by the alphabet S = 
<S m , the state space S 3 = M x M>o, such that £j(t) = (xj(t),lj(t)), and the 
dynamics 

Xj{0) = 

Xj(t+l) = Xj(t) + lj(t+ l)sj(t+l) Vt > 0, 



and 



ij(0) = h e M 
J i (l) = io 



fcout ^(i) if !«,•(*)! = 1 



The sent symbol is 



,( j " 9 I i At) ) 



vt > o. 



Let us comment on such definition. Remark that the first component of the 
coder/decoder state contains x(t), the estimate of x(t). The transmitted mes- 
sages contain a quantized version of the estimation error Xj (t) — Xj(t—l) scaled 
by the factor lj(t). Accordingly, the second component of the coder/decoder 
state, lj, is referred to as the scaling factor: it increases when \xj(t) — Xj(t — 
1)| > lj(t) ("zooming out step") and decreases when \xj(t) — Xj(t — 1)| < lj(t) 
("zooming in step"). 

We can now prove the main theorem of this chapter. 
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Theorem 2 (Convergence) Consider the system (11) with the zooming cod- 
ing. Let p be the essential spectral radius of I + K . Suppose that p < k m < 1, 
m > an d that l > 2 ^ +2 ^^ff^ . Then, for any initial condition 

x(0) G R N , 

lim x(t) = lim x(t) = x ave l, 

t — >+oo t — >+oo 

and the convergence is exponential, with rate not bigger than k[ n . 

Proof: First, observe that 1*K = 0, and then the states update rule pre- 
serves the average of the state x(t) at each time step. Hence if we prove conver- 
gence to a consensus value, that will be the average. Let us rewrite the overall 
system as the coupling of the three dynamical systems on R^, 




if \Xj(t+ 1) -Xj(t)\ > 1 



x(0) = x 

x(t + l)=x(t)+Kx(t) VieZ> 



Xj(0) = VjeV 

Xj (t + 1) = Xj (t) + l 3 {t + l)g<"0 ( ^±Il_MT) 



Their coupling implies that the following facts are equivalent: 

(i) lim l(t) = 0; 

t— *+oo 

(ii) lim x(t) = JWel; 

t — >-\-oo 

(iii) lim (x(t) - x(t)) = 0. 

t — >-foo 

The idea of the proof is the following: we show that under the assumptions 
there always happen zooming in steps. This implies l(t) = fc'~ 1 Zol and implies 
in turn convergence to average consensus. 

By definition, there are only zooming in steps if 

\xj(t+ 1) -Xj(t)\ < lj(t+ 1) Viey,teZ> (13) 

or equivalently if 

\xj(t + l)- Xj (t)\ < klJo Vi£V,teZ> Q . (14) 
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Let us define y(t) = Kx(t) and e(t) = x(t) — x(t), and remark that (14) is 
equivalent to 

\y(t) ~ (K - I)e(t)\ <k*J , (15) 

where the inequality is meant componentwise. 

To prove this fact, we proceed by strong induction over t, proving that for 
all t G Z>o 

wmw < k iJ (i6) 

\\y(t) - (K - I)e(t)\\ < kfjo. (17) 

Since \\y(t) - {K - I)e{t)\\ x < \\y(t) - (K — I)e(t)\\, the inequality (17) implies 
(14) and then convergence. 

Let us thus check the validity of Equations (16) and (17) for t = 0, t = 1, 
and for a general t + 1, with t G N, given it true for all t' < t. We shall use the 
recursion 

y(t + l) = (I + K)y(t)-K 2 e(t) 1 

as well as Lemma 1, which implies ||e(t)|| < ■^-lo- 

Using triangle and submultiplicativc inequality of norms, and ||/+ K\\ = p, 
\\K\\ < 2, and \\K - I\\ < 3, we get that 

t = 0. (16) holds if \\Kx \\ < l , and (17) holds if ||x ||oo < ^o- 
t = 1. (17) holds if 



VN 

2(2 + p)\ x \ +3—l < hJ , (18) 
m 

and (16) holds if 

H-Ksoll < hJo- (19) 

t > 1. Assuming (16) and (17) true for time steps t and t — 1, we obtain that 
(17) holds for the time step t + 1 if 



that is if 



pkl + 4^fc*- 1 / + 3^~ k tJo < k*+H , 



P k in + 4— + 3— k iB < kf n . (20) 
m m 



Instead, (16) holds if 



pfc in + 4— <kl. (21) 
m 



The system of conditions (18)-(19)-(20)-(21) is satisfied when the assumptions 
of the theorem hold. □ 
This result is quite conservative in proving convergence, since it guarantees that 
since the beginning only zooming in steps happen. This is clearly restrictive, 
since there is no need for l(t) to be monotonic to converge to zero. 
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5 Simulation results 



In this section we show by simulations the properties of the algorithm in terms 
of (speed of) convergence, as it depends on the parameters of the method, 
fcin,fcout and m, and on the topology of the graph. Indeed, the convergence 
result we obtained, Theorem 2, gives sufficient conditions on the parameters, 
depending on p, and on N, and thus on the graph. Convergence is possible, 
provided the conditions, at exponential speed, with rate k m > p. Simulations 
are worth of interest, since they demonstrate that convergence is possible also 
outside the scope of Theorem 2, and with a speed which can be faster than the 
linear algorithm with ideal communication (4). 

Roughly speaking, we can identify two different regimes for the evolution 
of the algorithm, depending on the zooming-in rate ki n which is enforced. If 
fcin > p, the zooming-in follows the natural contraction rate of the system, 
and according to the spirit of the proof of Theorem 2, eventually (almost) only 
zooming-in steps happen, and the rate of convergence is (no better than) k- m . 
The choice of fc ou t plays essentially no role. If instead h ln < p, the state does 
not contract fast enough for a stationary sequence of zooming-ins to establish. 
Then, zooming-in and zooming-out steps alternate in a complicated way, leading 
anyhow to consensus, with an evolution which depends on both fc; n and fc ou t: 
the convergence can be faster than in the ideal case. Such phenomenon is rather 
surprising at a first glance, but we can explain it intuitively if we consider that 
the zooming-in/zooming-out algorithm takes advantage of the use of memory, 
and thus the sent messages are actually more informative. 

Most of the simulations regard ring graphs, because concentrating on a sim- 
ple example of a poorly connected graph helps to highlight the features of the 
algorithm. Weights of matrices P have been chosen according to a maximum 
degree rule. Hence a ring of N = 20 nodes induces a matrix whose essential 
spectral radius is p = 0.9673. The initial conditions have been generated ac- 
cording to a gaussian distribution, and all simulations with 20 nodes start from 
the same initial condition. 

The transition between the two regimes is explored in Figure 1, confirming 
the role of p. Instead, Figures 2 and 2 consider the role of the number of 
quantization levels m. In the k- m > p regime, at least m — 3 is required for 
convergence, and increasing m leads to improve the rate, approaching k m . In 
the fci n < p regime, m = 1 is enough for convergence, and increasing m leads to 
slightly improve the rate. Since |<S m | = to+2, then 5 and 3 symbols are sufficient 
for convergence, respectively. If, taking advantage of the synchrony, one encodes 
the middle level, which is zero whenever m is odd, as a no-signal, the required 
number of level can be obtained with only two bits (one bit, respectively). 

The scaling properties of the algorithm are a main point of interest. Fig- 
ure 4 considers how the performance of the algorithm (with fixed parameters) 
degrades as N increases, in a sequence of ring graphs. The plot shows that m 
need not to depend on N as required Theorem 2. Instead, Figure 5 considers 
two cases in which the zooming factors fcj n and A: ou t are depends on the graph, 
in such a way to keep the evolution in the same regime, in spite of the growth 



of TV. 
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Figure 1: Ring graph. Dependence on k- m : remark the threshold p = 0.9673. 
N = 20, m = 6, fc out = 2. 



Not to restrict ourselves to ring graphs, we show some simulations regarding 
random geometric graphs in Figure 6. The plots show how the performance 
depends on the topology of the geometric graph: different samples have different 
spectral radiuses, and then different convergence rates in the ideal case. Instead, 
in most cases the zooming algorithm is in the k ln < p regime, and then the 
performance is roughly independent of the sample. This suggests that in this 
regime the algorithm is little sensitive to the spectral radius, and rises the 
question of which is a significant graph theoretic index. 



6 Conclusions 

With theoretical and experimental results we showed that using the zooming 
scheme the average consensus problem can be efficiently solved although the 
agents can send only quantized information. Indeed the systems converge to 
average consensus at exponential speed, with a convergence rate which can be 
chosen as small as the convergence rate of consensus with perfect exchange of 
information, provided the number of quantization levels is large enough. Though 
the theoretical results arc quite conservative the efficiency of these methods is 
apparent from simulations, which show the method to converge outside the 
scope of current results, and converge at a rate faster than the ideal algorithm. 
Improving the theoretical analysis is thus a major concern, especially about the 
issue of scalability in the number of agents. 
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Figure 2: Ring graph, in the k- m > p regime. N = 20, k in = 0.97, k out = 2. 

We have already underlined in Remark 1 that the algorithm requires the 
states estimates to be shared among neighbors. This implies that the algorithm 
is not suitable, in the present form, for implementation on a digital noisy chan- 
nel, unless we allow a feedback on the channel state. A natural development of 
this research is thus designing algorithms to solve the average consensus problem 
at exponential speed over a network of digital noisy channels. 
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Figure 6: Different performance on different samples of random geometric graph 
with R = 0.5. m = 3, k- m = 0.3, fc ou t = 2. 
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